Systems and methods of augmenting objects associated with personal data

ABSTRACT

Systems and methods of augmenting objects associated with personal data. A system includes a communication module, a processor, and a memory. The memory stores instructions that, when executed, configure the processor to authenticate a client device based on a credential associated with an account record. The processor receives, from the client device, an indication of a document marker and obtains, from the account record, personal data associated with the document marker. The processor transmits, to the client device, display data based on the personal data. The display data configures the client device to display an augmented reality output based on the personal data and at least one further image of the document. The personal data may include dynamic data varying over time. The display data configuring the client device to display the augmented output may be based on current personal data obtained from the account record.

TECHNICAL FIELD

The present application relates to augmented reality systems and, inparticular, to systems and methods of augmenting objects associated withpersonal data.

BACKGROUND

Augmented reality systems can provide users with interactiveexperiences, where objects, when viewed via a computing device, in areal-world environment may be augmented with computer-generatedinformation. The computer-generated information may be displayed incombination with representations of objects in the real-worldenvironment. In some examples, the computer-generated information mayprovide additional information related to respective objects in thereal-world environment.

For example, a computing device may include an image capture device anda display output device. The display output device may provide alive-view image of an object while the image capture device capturesimages of the object. An augmented reality application may supplementthe live-view image of the object with computer-generated information.The computer-generated information may be constructively combined withthe live-view image of the object or may selectively mask portions ofthe object provided in the live-view image.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments are described in detail below, with reference to thefollowing drawings:

FIG. 1 illustrates, in block diagram form, a system of augmentingobjects associated with personal data, in accordance with an example ofthe present application;

FIG. 2 illustrates a signal diagram illustrating exchanges amongcomputing devices for augmenting objects associated with personal data,in accordance with an example of the present application;

FIG. 3 illustrates a document on which augmented reality objects basedon personal data may be provided, in accordance with an example of thepresent application;

FIG. 4 illustrates, in flowchart form, a method of augmenting objectsassociated with personal data, in accordance with an example of thepresent application;

FIG. 5 illustrates the document of FIG. 3 having computer-generatedaugmented reality output integrated thereon, in accordance with anexample of the present application;

FIG. 6 illustrates an example partial view of the document of FIG. 3;

FIG. 7 illustrates, in flowchart form, a method of augmenting objectsassociated with personal data, in accordance with an example of thepresent application;

FIG. 8 illustrates, in simplified block diagram form, an electronicdevice, in accordance with an example of the present application; and

FIG. 9 illustrates, in simplified block diagram form, a server, inaccordance with an example of the present application.

Like reference numerals are used in the drawings to denote like elementsand features.

DETAILED DESCRIPTION OF VARIOUS EMBODIMENTS

In one aspect, the present application may describe a computing systemthat includes: a communication module; a processor coupled to thecommunication module; and a memory coupled to the processor. The memorystores instructions that, when executed, may configure the processor to:authenticate a client device based on a credential associated with anaccount record; receive, from the client device, an indication of adocument marker, wherein the document marker is based on an image of adocument; obtain, from the account record, personal data associated withthe document marker; and transmit, to the client device, a display databased on the personal data, the display data for configuring the clientdevice to display an augmented reality output based on the personal dataand at least one further image of the document.

In some implementations, the personal data may include dynamic datavarying over time. The instructions, when executed, may furtherconfigure the processor to generate the display data for configuring theclient device to display the augmented output based on current personaldata obtained from the account record.

In some implementations, the document includes legacy data associatedwith the account record, and the displayed augmented reality output mayinclude output based on the current personal data overlaying the legacydata to obscure the legacy data.

In some implementations, the personal data may include banking accountdata having dynamically changing value over time, and the currentpersonal data may include a current market value of an accountassociated with the banking account data.

In some implementations, the augmented reality output includes alive-view display of the document.

In some implementations, the indication of the document marker mayinclude the image of the document, and the instructions, when executed,may further configure the processor to identify the document markerusing image recognition.

In some implementations, the augmented reality output may include atleast one of graphs or charts associated with the personal data.

In some implementations, the document marker may include at least one ofa keyword, a barcode, or a graphical symbol.

In some implementations, the instructions, when executed, may furtherconfigure the processor to: receive, from the client device, a userselected subset of the augmented reality output; and transmit furtherdisplay data for displaying the selected subset of the augmented realityoutput at the client device.

In another aspect, the present application may describe acomputer-implemented method of augmenting objects associated withpersonal data. The method may include: authenticating a client devicebased on a credential associated with an account record; receiving, fromthe client device, an indication of a document marker, where thedocument marker may be based on an image of a document; obtaining, fromthe account record, personal data associated with the document marker;and transmitting, to the client device, display data based on thepersonal data, the display data for configuring the client device todisplay an augmented reality output based on the personal data and atleast one further image of the document.

In some implementations, the personal data may include dynamic datavarying over time, where the method may further comprise generating thedisplay data for configuring client device to display the augmentedoutput based on current personal data obtained from the account record.

In some implementations, the document may include legacy data associatedwith the account record, and wherein the displayed augmented realityoutput includes output based on the current personal data overlaying thelegacy data to obscure the legacy data.

In some implementations, obtaining the personal data associated with thedocument marker may be subsequent to authenticating the client devicebased on the credential.

In some implementations, the augmented reality output may include alive-view display of the document.

In some implementations, the indication of the document marker mayinclude the image of the document, and the method may further compriseidentifying the document marker using image recognition.

In some implementations, the augmented reality output may include atleast one of graphs or charts associated with the personal data.

In some implementations, the document marker may include at least one ofa keyword, a barcode, or a graphical symbol.

In some implementations, the method may further include: receiving, fromthe client device, a user selected subset of the augmented realityoutput; and transmitting further display data for displaying theselected subset of the augmented reality output at the client device.

In another aspect, a non-transitory computer-readable storage medium isprovided to store processor executable instructions that, when executed,cause a processor of a computing device to carry out the operations ofone or more methods described herein. The computer-readable storagemedium may include instructions for augmenting objects associated withpersonal data. For example, the processor executable instructions mayconfigure the processor of the computing device to cause the computingdevice to authenticate a client device based on a credential associatedwith an account record; receive, from the client device, an indicationof a document marker, where the document marker is based on an image ofa document; obtain, from the account record, personal data associatedwith the document marker; and transmit, to the client device, displaydata based on the personal data, where the display data may configurethe client device to display an augmented reality output based on thepersonal data and at least one further image of the document.

Other aspects and features of the present application will be understoodby those of ordinary skill in the art from a review of the followingdescription of examples in conjunction with the accompanying figures.

In the present application, the term “and/or” is intended to cover allpossible combinations and sub-combinations of the listed elements,including any one of the listed elements alone, any sub-combination, orall of the elements, and without necessarily excluding additionalelements.

In the present application, the phrase “at least one of . . . or . . . ”is intended to cover any one or more of the listed elements, includingany one of the listed elements alone, any sub-combination, or all of theelements, without necessarily excluding any additional elements, andwithout necessarily requiring all of the elements.

While examples described herein include data or fulfillment serversassociated with banking institutions, the systems and methods describedherein may also be applicable to servers associated with non-bankinginstitutions that store and process personal data. For example,non-banking data servers may include government operated computerservers for administering taxation programs, retail company servers foradministering customer loyalty/incentive programs, among other examples.Personal data may be data that, if misappropriated, may be perilous to auser's identity or may be considered a privacy breach.

Augmented reality systems may provide users with an interactiveexperience. Objects in a real-world environment may be augmented withcomputer-generated information. The computer-generated information maybe provided by an output module (e.g., display screen, loudspeaker, orthe like) in combination with a representation of the objects in thereal-world environment. In some examples, the augmentation may bevisual, auditory, haptic, or olfactory in nature. In some examples, thecomputer-generated information may be constructive. That is, areal-world object may be supplemented with the computer-generatedinformation. In some examples, the computer-generated information may bedestructive. That is, the computer-generated information may selectivelymask or be overlaid on a representation of an object in the real-worldenvironment. Example augmented reality systems augment a user'sexperience by integrating representations of objects in the real-worldenvironment with computer-generated information.

In some examples, an augmented reality system may augment a documentassociated with resources, such as services, monetary value, goods,digital assets, or the like, corresponding to a user. To illustrate, adocument may be a bank statement for a user and the bank statement mayprovide a summary of resources and associated market value of theresources. It may be appreciated that while examples described hereinrelate to bank related documents for respective targeted users, exampledocuments may be other types of non-bank related documents associatedwith personal data of a user. In some examples, the augmented realitysystem may augment objects that may be associated with personal data. Insome examples, personal data can include names, addresses, taxpayeridentification numbers, bank account summaries, personal investmentportfolio information, or the like. The personal data may include datathat, if misappropriated by an unscrupulous entity, may be used forconducting fraudulent activity or that may be injurious to a user.

In some examples, a fulfillment server may generate a hard-copy documentfor a user. The fulfillment server may be associated with a bankinginstitution and the banking institution may provide one or more bankaccounts for tracking monetary value of a user. The hard-copy documentsmay be periodically generated and sent to a user and may provide asummary of the one or more bank accounts for that user at a particularpoint in time (e.g., end of month, end of quarter, etc.). Becausegenerated documents may provide a summary at a particular point in time,in some scenarios, a generated document containing informationassociated with a time-varying value may become obsolete when receivedby an intended user. That is, the intended user may receive thegenerated document including data regarding market value of assets oneor more days after the document was generated. In some further examples,unintended users or entities may handle hard-copy documents associatedwith personal data. It may be desirable to provide systems and methodsfor presenting personal data to authenticated users and, in addition, toprovide systems and methods for presenting substantially real-timeupdates associated with personal data to the authenticated users.

Reference is made to FIG. 1, which illustrates in block diagram form, asystem 100 of augmenting objects associated with personal data, inaccordance with an example of the present application. As described, insome examples, personal data may include data associated with bankingaccounts or resource records. In some other examples, it may beunderstood that personal data may include other types of data innon-banking contexts, the misappropriation of which by an unscrupulousentity may be injurious to a user associated with that personal data.

The system 100 includes a client device 110 and a fulfillment server120. Although

FIG. 1 illustrates a single client device 110 and a single fulfillmentserver 120, in some examples, any number of client devices orfulfillment servers may be included. The fulfillment server 120 may be adata server associated with a banking institution. Further, the clientdevice 110 may be associated with a user. In some examples, a givenclient device 110 may be utilized by two or more users, where eachrespective user may provide authentication credentials (e.g., loginname, passcode, or the like) when utilizing the client device 110 orwhen interfacing with an application of the client device 110.

The system 100 may include a network 150. The client device 110 and thefulfillment server 120 may be configured to communicate over the network150 with one another or with any other similar computing device. Thenetwork 150 may include one or a combination of interconnected wired orwireless networks, including the Internet, local area networks, wirelessarea networks, or the like.

As described, the client device 110 may be associated with a user. Theclient device 110 may be configured to receive input and may beconfigured to interact with the user. For example, the client device 110may include an interactive application 112 having processor executableinstructions stored in memory that, when executed, cause a processor toconduct operations described herein for receiving user input via aninput module or providing augmented reality output on an output module.In illustrative examples, the interactive application 112 may be amobile banking application associated with the fulfillment server 120(e.g., banking institution server). As will be described herein, theinteractive application 112 may receive input, such as an image of adocument or object, and may conduct actions or generate an augmentedreality output based on received signals or display data from thefulfillment server 120. Other types of applications may be contemplated.

The client device 110 may also include document data 114 stored inmemory that may be associated with input received from a user. Forexample, the document data 114 may include data associated with documentimages captured by an image capture device 116. The document data 114may be transmitted to the fulfillment server 120 or the document data114 may include indications of document markers described herein. Theindications of the document markers may be associated with providingaugmented reality output.

The image capture device 116 may be configured to capture images ofobjects or documents. The client device 110 may include an input/outputmodule 118 and the user may interact with the client device 110 via theinput/output module 118. In some examples, the input/output module 118may include a touch screen display for displaying a user interface and atouch screen interface for receiving motion or touch input from theuser. In some examples, the input/output module 118 may include aphysical keyboard, a pointing device, or other examples of input devicesfor receiving user input. A user may interact with the client device 110via the input/output module 118.

The fulfillment server 120 may be a single server, multiple servers, aserver farm, or any other such arrangement of computing devices toimplement computing server-like functionality. The fulfillment server120 includes one or more processors, memory, and a communication modulefor providing communications capabilities with other computing devices.In the example where the fulfillment server 120 may be associated with abanking institution, the fulfillment server 120 may manage accountsassociated with at least one user.

The fulfillment server 120 may include an augmentation application 122for augmenting objects associated with personal data. The augmentationapplication 122 may include processor executable instructions stored inmemory that, when executed, cause a processor to conduct operationsdescribed herein. For example, the augmentation application 122 maycause a processor to authenticate a client device 110 based on acredential associated with a client data record and receive, from theclient device 110, an indication of a document marker. The documentmarker may be based on an image of a document. The processor may obtain,from the client data record, personal data associated with the documentmarker and transmit, to the client device 110, display data based on thepersonal data. The display data may configure the client device 110 todisplay an augmented reality output based on the personal data and atleast one further image of the document.

The fulfillment server 120 may include client data records 124. Theclient data records 124 may include a data structure having informationassociated with one or more users. The users may be associated withand/or authenticated at a client device 110. Example client data records124 include a running balance of monetary value associated with bankaccounts (e.g., savings account, chequing account, etc.), investmentaccounts, lending accounts (e.g., mortgage accounts, line-of-creditaccount, etc.), or the like. Respective client data records 124 or bankaccount information may be associated with a user identifier or acredential associated with respective users.

The fulfillment server 120 may include resource records 126. Theresource records 126 may track resources, including currency, monetaryvalue, digital assets, tokens, precious metals, among other examples. Insome examples, a client data record 124 may be associated with aresource record 126. The association between the client data record 124and the resource record 126 may be used to track a real-time orsubstantially real-time value of accounts or investment instruments.

As described, personal data includes data that may be consideredconfidential. As hard-copy documents may unintentionally be exposedwhile being transported (e.g., via postal mail), it may be desirable tolimit the quantity of personal data included in hard-copy documents andto augment documents with supplemental personal data upon authenticatinga user associated with the document. Further, personal data may includedynamic data that may vary over time. For instance, market value of amutual fund or a chequing account balance may vary over the course of aday, week, month, or other time period. It may be desirable to augmentdocuments with real-time or substantially real-time data for providing auser with current information.

Reference is made to FIG. 2, which illustrates a signal diagram 200illustrating exchanges among computing devices for augmenting objectsassociated with personal data, in accordance with an example of thepresent application. The signal diagram 200 includes the example clientdevice 110 and the fulfillment server 120 of FIG. 1.

The signal diagram 200 illustrates operations that may be implemented,at least in part, through processor executable instructions stored atone or more of the computing devices. The operations may be carried outby one or more processors of the respective devices, servers, orapplications thereon. Further, the signal diagram 200 illustratesoperations or exchanges associated with particular computing servers ordevices. Although a particular operation may be illustrated as beingconducted at a particular device, it may be contemplated that theparticular operation may be conducted alternatively at another device.For example, in a scenario where a user enters an authenticationpasscode, operations for validating the user identity may be conductedat the client device 110, at the fulfillment server 120, or at acombination of the client device 110 and the fulfillment server 120.

To illustrate example operations of the present application, the clientdevice 110 may be associated with a user and the interactive application112 (FIG. 1) may be a mobile banking application associated with thefulfillment server 120 (e.g., banking institution server). Theinteractive application 112 may include instructions that, whenexecuted, cause the processor to execute operations described herein forproviding an augmented reality output based on personal data.

At operation 202, the client device 110 may display a request to theuser for an authentication credential. The authentication credential mayinclude a client card number, account number, username, or passcode,among other examples. The authentication credential may authenticate theuser for an action while the user operates the client device 110. Insome examples, the client device 110 may include authentication recordsfor authenticating the user at the client device 110.

In some other examples, the fulfillment server 120 may conduct theauthentication. At operation 204, the client device 110 may transmit thereceived authentication credential to the fulfillment server 120 and, atoperation 206, the fulfillment server 120 may determine whether thereceived authentication credential matches a credential associated witha client data record 124 (FIG. 1). That is, the fulfillment server 120may authenticate the client device based on a credential associated withan client data record 124.

At operation 208, the fulfillment server 120 may transmit anauthentication result indication the client device 110.

In some examples, once the user is authenticated, the interactiveapplication 112 of the client device 110 may maintain an authenticatedsession with the augmentation application 122 of the fulfillment server120 until such time that a session ending command is provided or thesession is otherwise terminated. In some other examples, the clientdevice 110 may be configured to associate an authentication credentialwith indications of document markers or with other requests/queries,such that the fulfillment server 120 conducts authentication operationswhen respective transmissions between the client device 110 and thefulfillment server 120 are made.

At operation 210, the client device 110 may capture, via the imagecapture device 116 (FIG. 1), an image of a document. To illustrate, thedocument may be a paper-based investment product statement associatedwith a brokerage account. The document may summarize performance ofinvestment products up to a fixed point in time (e.g., end of a fiscalor calendar quarter). In some examples, the document may include generalpersonal information associated with the user, such as a name, address,and a summary listing of investment products or value. In some examples,the document may lack detailed information deemed confidential orsensitive to the user. For instance, the document may lack detailsoutlining the investment portfolio mix (e.g., percentage holdings), theadjusted cost base value (e.g., for determining changes in portfoliovalue since opening an account), or other information that may be deemedpersonal and confidential.

At operation 212, the client device 110 may transmit an indication of adocument marker to the fulfillment server 120. In some examples, theclient device 110 may parse the document image to identify one or moredocument markers. The document marker may be based on an image of thedocument. For example, the document marker may be a keyword, a barcode,or a graphical symbol printed on the document. As will be described, infurther operations, the fulfillment server 120 may obtain personal dataor generate augmented data for the authenticated user based on thedocument marker. In some examples, the identified document marker may betransmitted to the fulfillment server 120. In some other examples, theclient device 110 may include instructions to cause a processor todecipher what action or query may be associated with the document markerand, subsequently, transmit that indication of the document marker tothe fulfillment server 120.

In some examples, an indicator of the document marker may be the imageof the document itself and the client device 110, at operation 212, maytransmit the image of the document to the fulfillment server 120. In thepresent example, the fulfillment server 120 may parse the document imagefor identifying one or more document markers based on image recognitionoperations.

At operation 214, the fulfillment server 120 receives the indication ofthe document marker and obtains, from one or more client data records124, personal data associated with the document marker. In someexamples, the fulfillment server 120 may obtain the personal dataassociated with the document marker subsequent to authenticating theclient device 110 based on the credential.

Continuing with the above-described example, the fulfillment server 120may retrieve a client data record associated with the user of theauthenticated client device and may obtain personal data associated withthe document marker. For instance, the document marker may be a keywordphrase “registered accounts”. In some scenarios, the document mayinclude a summary listing of investment products associated with theuser's “registered accounts”; however, it may be desirable to provide adetailed view of the investment products. Accordingly, the fulfillmentserver 120 may be configured to generate the personal data based on dataentries stored in the client data record. In some examples, thefulfillment server 120 may generate graphical illustrations of theportfolio allocation of investment products associated with the user.Based on the obtained personal data, the fulfillment server 120 maygenerate display data for configuring the client device 110 to displayan augmented reality output based on the personal data.

At operation 216, the fulfillment server 120 transmits, to the clientdevice 110, the display data based on the personal data for configuringthe client device 110 to display an augmented reality outputsupplementing the image of the document.

At operation 218, the client device 110 generates an augmented realityoutput for display via the input/output module 118. For example, whilethe user positions the client device 110 adjacent to the document suchthat the image capture device 116 captures an image of the document, thedisplay data received from the fulfillment server 120 may configure theclient device 110 to overlay augmented reality content overtop the imageof the document. Accordingly, using a display screen or other outputmodule, the user may view a combination of the document and theaugmented reality content based on the personal data.

In some examples, while the user positions the client device 110adjacent the document, the client device 110 may provide a live-viewdisplay of the document. Once the client device 110 conducts the exampleoperations described in the signal diagram of FIG. 2 and receives thedisplay data associated with augmented reality output, the client device110 may display the supplemental content as augmented reality contentwithin the live-view display of the document.

In some examples, a user-specific document may be a hard-copy documentthat was prepared for a particular user. That is, the document mayinclude a user-specific document marker, such as a barcode, a name, anaccount number, or other unique identifier, that is associated withpersonally identifying information of the specific user. As will bedescribed, the client device 110 may be configured to display, via alive-view display, augmented reality output in combination with a visualrepresentation of the user-specific document when: (1) the client device110 authenticates the specific user via the interactive application 112;and (2) the client device 110 identifies that the user-specific documentmarker is associated with the specific user who has been authenticatedat the client device 110. In the present example, the client device 110may provide augmented reality output in combination with a user-specificdocument on the live-view display when the specific user isauthenticated (e.g., logged in) at the client device 110. Conversely,the client device 110 may not provide the augmented reality output incombination with the above-described user-specific document when analternate user is authenticated (e.g., logged in) at the client device110. In the latter scenario, although the alternate user may beauthenticated at the client device 110, the user-specific marker of theabove-described user-specific document may not be associated with thealternate user and thereby prevents display of the user-specificaugmented reality output, or any augmented reality output, to thealternate user.

In some examples, the document may be non-user specific. That is, thedocument may be a generic document for triggering augmented realityoutput to be displayed at the client device 110. For instance, thedocument may be a chequing account statement template that may includesection headers. The chequing account statement template may be astandard form for printing user specific information thereon. To addresssome of the challenges relating to keeping hard-copy documents unexposedto unscrupulous parties, example systems and methods described hereinmay provide user-specific augmented reality output based, in part, on adocument template defining data types to be provided as augmentedreality output.

In one example, the client device 110 may be configured to displayuser-specific augmented reality output in combination with a visualrepresentation of the chequing account statement template. Therespective section headers may be document markers. The client device110 or the fulfillment server 120 may determine the data type(s) anduser-specific data that may be included in the augmented reality output.For example, the chequing account statement template may include theheadings: overall balance, total credits, total debits, overdraft limit,or the like, and the headings may identify data type(s) to be includedin the augmented reality output. The data type(s) may be applicable tousers who may have an associated chequing account statement.Accordingly, when a first user is authenticated at the client device110, the client device 110 may provide augmented reality output thatincludes a first set of data associated with the first user for each ofthe overall balance, total credits, total debits, overdraft limit, orthe like. Similarly, when a second user is authenticated at the clientdevice 110, the client device 110 may provide augmented reality outputthat includes a second set of data associated with the second user foreach of the overall balance, total credits, total debits, overdraftlimit, or the like. Thus, the example chequing account statementtemplate may be used by any one of multiple users for triggeringaugmented reality output that may be specific to the authenticated userat the client device 110.

In the examples described herein, the generated augmented reality outputmay be displayed in response to a successful user authentication. Theaugmented reality output may include supplemental content based onpersonal data of a particular user that may be confidential. Thus, thesystems and methods described herein may provide access controlsassociated with displaying or otherwise providing supplemental contentto a successfully authenticated user. That is, the fulfillment server120 may provide personal information using augmented reality output on auser-by-user basis.

Reference is made to FIG. 3, which illustrates a document 300 on whichaugmented reality objects based on personal data may be provided, inaccordance with an example of the present application.

Continuing with above described examples, the fulfillment server 120(FIG. 1) may be associated with a banking institution and the clientdevice 110 may be associated with a user. The document 300 may be aperiodic statement providing a listing of products associated with auser.

The document 300 may include an institution logo 302 that identifies abranch of the banking institution. For example, the institution logo 302may be a logo for the wealth management division of the bankinginstitution. The institution logo 302 may be an example of a documentmarker. In the present example, the institution logo 302 may be includedon a template investment statement. Accordingly, when the fulfillmentserver 120 identifies the institution logo 302 as a document marker, thefulfillment server 120 may identify a set of data types associated withthe template investment statement. In the present example, when thefulfillment server 120 generates display data to display an augmentedreality output, the augmented reality output may include user dataassociated with each of the respective data types associated with thetemplate investment statement.

The document 300 may include a general user identifier 304 associatedwith the user. Further, the general user identifier 304 may be anotherexample document marker. The general user identifier 304 may includehigh-level information that may be used to uniquely identify the userand may not include specific details, such as an address, birthdate,taxpayer identification number, or the like. In the illustrated example,the user is “Jane Doe” and a client number may be provided. In somescenarios, the client number may be an assigned number that may not haveany significance to an organization other than the banking institutionassociated with the institution logo 302.

In the example where the document 300 is a user-specific document (e.g.,aforementioned example user-specific document), the fulfillment server120 may generate display data to display an augmented reality output incombination with the user-specific document only in response todetermining that the general user identifier 304 is associated with theauthenticated user of the client device 110. That is, in the scenariowhere the general user identifier 304 (e.g., Jane Doe) is not associatedwith the authenticated user (e.g., Bob) of the client device 110, thefulfillment server 120 may not generate the display data to display anyaugmented reality output in combination with the user-specific document.

The document 300 may also include a summary list 306 of products thatmay be associated with the user. The summary list 306 may provide alisting of product names and an aggregate total value associated withthe respective products for the user. In some examples, a product namemay be supplemented with a product logo 308. The product logo 308 may beanother example document marker. In some examples, when the fulfillmentserver 120 identifies the product logo 308 as a document marker, thefulfillment server 120 may identify a set of data types associated withthe product logo 308. As will be described in a subsequent illustratedexample, the set of data types may include data relating to cashholdings, securities holdings, equity holdings, or the like. Thus, thefulfillment server 120 may be configured to retrieve data relating tocash holdings, security holdings, equity holdings, or the like, that isassociated with the user (e.g., the user who has authenticated with thefulfillment server 120 and/or the client device 110).

The document 300 may further include a section for identifyingBeneficiaries 310 of the user. In some scenarios, beneficiaryidentification may be confidential information that users may not wishto be published. In the example illustrated in FIG. 3, the term“Beneficiaries” may be another example document marker. That is, whenthe fulfillment server 120 identifies the term “Beneficiaries” as adocument marker, the fulfillment server 120 may be configured toretrieve data relating to a beneficiary name that is associated with theuser (e.g., the user who has authenticated with the fulfillment server120 and/or the client device 110).

The document 300 may include a document barcode 312, which may beanother example document marker. The document barcode 312 may encodedata for identifying the document type, document version, or otherattributes associated with the document 300. For instance, the documentbarcode 312 may be a 1-dimensional barcode, a 2-dimensional barcode, orother type of barcode. In an example where the document 300 illustratedin FIG. 3 is a user-specific document, the document barcode 312 maycorrespond to user identification data (e.g., Jane Doe).

Further, the fulfillment server 120 may be configured to retrieve dataassociated with the one or more of the illustrated document markers inresponse to determining Jane Doe is the authenticated user (e.g., JaneDoe has authenticated with the fulfillment server 120 and/or the clientdevice 110). Thus, augmented reality output is combined with a visualrepresentation of the document 300 when: (1) Jane Doe authenticates withthe fulfillment server 120 and/or the client device; and (2) thefulfillment server validates that the user (e.g., Jane Doe) associatedwith the document barcode 312 corresponds to the user authenticated withthe fulfillment server 120 and/or the client device 110).

In another example, an alphanumeric text string may be an exampledocument marker. For example, the document 300 of FIG. 3 includes thetext string “$23,111”. In the present example, the fulfillment server120 may be configured to query a client data record 124 associated withthe user (e.g., the user who has authenticated with the fulfillmentserver 120 and/or the client device 110) to identify furthersupplemental data associated with the text string “$23,111”. As anillustration, the fulfillment server 120 may identify the data typeassociated with the text string “$23,111” and, subsequently, determinethat updated user data associated with that identified data type may beavailable. Thus, the fulfillment server 120 may generate display data toprovide an augmented reality output to overlay the updated user dataatop the text string “$23,111” in a visual representation of thedocument 300. In the present example, the document 300 may have dataprinted thereon that is outdated. Accordingly, the text string $23,111may be an example document marker for triggering augmented realityoutput for providing updated user data.

The fulfillment server 120 may be configured to retrieve datacorresponding to the authenticated user and associated with one or acombination of any number of document markers and, subsequently,generate display data for displaying an augmented reality outputassociated with the retrieved data. The institution logo 302, thegeneral user identifier 304, the summary list 306, the product logo 308,or the document barcode 312 are illustrative examples of documentmarkers and other examples may be contemplated. For instance, documentmarkers may include the document date, document numbers, or otheridentifying feature of the document 300. In one example, the fulfillmentserver 120 may utilize a document date for identifying a particularversion of the document 300.

Reference is made to FIG. 4, which illustrates, in flowchart form, amethod 400 of augmenting objects associated with personal data, inaccordance with an example of the present application. The method 400includes operations that may be carried out by one or more processors ofthe fulfillment server 120 (FIG. 1). For example, the method 400 may beimplemented, at least in part, through processor executable instructionsassociated with the augmentation application 122 (FIG. 1). In someexamples, one or more operations may be implemented via processorexecutable instructions in other applications or in an operating systemstored and executed on the fulfillment server 120.

Continuing with the example described above, the fulfillment server 120may be associated with a banking institution providing products to theuser. The user may interact with the client device 110. The clientdevice 110 may receive authentication credentials from the user prior toproviding augmented reality output. Further, the document 300illustrated in FIG. 3 may be a hard-copy document sent via postal mailor generated at a brick-and-mortar bank location. At least some of theoperations of the augmentation application 122 may provide an augmentedreality output based on personal data for supplementing the informationprinted on the document 300.

At operation 402, the processor authenticates the client device 110based on a credential associated with an account record (e.g., a clientdata record 124 of FIG. 1). In some examples, the client device 110 maybe associated with the user and the client device 110 may receive fromthe user a set of login credentials including a client identificationnumber and a passcode for activating the interactive application 112(FIG. 1). The interactive application 112 may be a mobile bankingapplication. The processor of the fulfillment server 120 may receive,from the client device 110, the login credentials and authenticate theclient device 110. The login credentials may be associated with one ormore of the client data records. Thus, the processor of the fulfillmentserver 120 may retrieve a data record associated with the user. Otheroperations for authenticating the client device 110 including operationsat one or a combination of the client device 110 and the fulfillmentserver 120 may be contemplated.

At operation 404, the processor receives, from the client device 110, anindication of a document marker. The document marker may be based on animage of the document 300. The document marker may include a productlogo 308 (FIG. 3), a keyword (e.g., the word “Beneficiaries”,“A-series”, etc.), a document barcode 312, or other features of thedocument 300. In some examples, the client device 110 may be positionedto capture an image of the entire document 300. The image may include aview of several document markers. In some other examples, the user mayposition the client device 110 adjacent the document 300 such that asubset portion of the document 300 may be imaged by the image capturedevice 116 (FIG. 1) of the client device 110. Depending on how thedocument 300 may be positioned within a field of view of the imagecapture device 116, the processor may capture an image including feweror greater number of document markers.

In some examples, the indication of the document marker may be the imageof the complete document. That is, the client device 110 may capture animage of the document 300 and, subsequently, transmit that image of thedocument 300 to the fulfillment server 120. In the present example, theprocessor (of the fulfillment server 120) may identify one or moredocument markers using image recognition operations. For example, imagerecognition operations may include optical character recognitionoperations or image parsing operations for identifying graphicalicons/logos or document barcodes.

In some other examples, the client device 110 may conduct the imagerecognition operations to identify one or more keywords, graphicalsymbols, or barcodes and, subsequently, may transmit a summary of theidentified document markers to the fulfillment server 120. In thepresent example, the summary of the identified document markers may besufficient for identifying associated personal data.

At operation 406, the processor obtains, from the account recordassociated with the authenticated user, personal data associated withthe document marker. For example, referring again to FIG. 3, thedocument includes the institution logo 302. The institution logo 302 maybe an example of a document marker. The processor may identify theinstitution logo 302 as a document marker and, in response, may identifythat the document may be a standard bank statement having a set of datatypes. For instance, the data types may include data for aggregate totalvalue of banking products, data indicating beneficiary designation, datafor providing granular details associated with the various bankingproducts, or the like. Accordingly, the processor may be configured toretrieve, from the data record associated with the authenticated user,personal data of the aforementioned example data types for theauthenticated user.

In another example, the document 300 of FIG. 3 includes the product logo308 and the summary list 306 of banking products. The processor mayidentify the product logo 308 and/or text-strings of the summary list306 (e.g., A-series, B-series, C-series, G-series, etc.) as documentmarkers and, in response, may be configured to retrieve data forproviding granular data or for generating visual summaries (e.g., piecharts, graphs, or the like) associated with the respective bankingproducts.

In another illustrating example, the processor may identify the textstring

Beneficiaries 310 as a document marker and obtain, from the data recordassociated with the authenticated user, beneficiary names. Thebeneficiary names may be an example of personal data which theauthenticated user may desire to remain confidential.

In another illustrating example, the processor may identify the documentbarcode 312 as a document marker. For instance, the document barcode 312may be a barcode encoded with information associated with a user. In anexample where the document 300 may be a user-specific document, theencoded information may be used by the fulfillment server 120 todetermine whether display data representing an augmented reality outputshall be generated. For example, the processor may decode the documentbarcode 312 and may determine that the document 300 is a user-specificdocument for “Jane Doe”. Thus, the processor may obtain, from the datarecord associated with “Jane Doe”, personal data only in response to:(1) the authenticated user of the client device 110 is determined to be“Jane Doe” (see operation 402); and (2) the authenticated user “JaneDoe” corresponds to the user (e.g., “Jane Doe”) associated with thedocument barcode 312. Conversely, in the present example, if theprocessor determined that the authenticated user of the client device110 is “John Smith”, the processor may refrain from obtaining personaldata for the document, at least, because the document 300 is auser-specific document for “Jane Doe”.

In some examples, the personal data associated with one or more documentmarkers may include dynamic data varying over time. As an illustratingexample, the personal data may include mutual fund market values thatmay fluctuate based on trends of major stock exchanges. In someexamples, the processor may generate display data to configure theclient device 110 to display an augmented output based on currentpersonal data obtained from the account record. In another example, thepersonal data may be banking account data having dynamically changingvalue over time, and the current personal data may include a currentmarket value of an account associated with the banking account data at acurrent time.

Based at least on obtained personal data associated with one or moredocument markers, augmented reality output may include textual data,graphical data, or other visualizations that may provide furthergranular or supplemental details associated with data types of thedocument 300. In some examples, augmented reality output may alsoinclude updated or current data associated with data types of thedocument 300 (e.g., updated banking product value, or the like). Thefulfillment server 120 may generate the display data for configuring theclient device 110 to display augmented reality output based, at least inpart, on the prior obtained personal data.

At operation 408, the processor transmits, to the client device 110,display data based on the personal data. The display data may configurethe client device 110 to display an augmented reality output based on:(1) the previously obtained personal data; and (2) at least one furtherimage of the document 300. In some examples, the at least one furtherimage of the document 300 may be successive subsequent images of alive-view document image accessed via the client device 110.Illustrative examples of augmented reality output based on the personaldata is shown with reference to FIG. 5.

Reference is made to FIG. 5, which illustrates the document 300 of FIG.3 having computer-generated augmented reality output integrated thereon,in accordance with an example of the present application. For ease ofexposition, in FIG. 5, augmented reality output features are highlightedwithin dotted line borders. It may be understood that when viewedthrough a display of the client device 110, the augmented reality outputfeatures may appear seamlessly integrated with one or more images of thedocument 300.

In one example, personal data including a registered taxpayeridentification number 520 may be associated with the combination ofdocument markers including: (1) the keyword expression “Jane Doe”; and(2) the document barcode 312. Thus, when the authenticated user (e.g.,Jane Doe) views an augmented reality output of the document 300 througha display of the client device 110, the registered taxpayeridentification number 520 may be provided on a live-view display. In thepresent example, the keyword expression “Jane Doe” may have beenidentified as a document marker and may be associated with a data typefor a taxpayer identification number. Accordingly, in some exampleoperations described herein, the fulfillment server 120 may haveobtained, from the data record associated with the authenticated user“Jane Doe”, the taxpayer identification number 520 for inclusion asaugmented reality output.

In another example, personal data including the names Bill Ip and AnnGreene 522 may be associated with the text string “Beneficiaries” (e.g.,a document marker). When the user views an augmented reality output ofthe document 300 using the display of the client device 110, the namesof the beneficiaries may be visible.

Similarly, when the user views an augmented reality output of thedocument, the supplemental breakdown of mutual fund products 530 (e.g.,dollar value of cash, securities, or equity associated with respectivemutual funds) may be visible via the client device 110. The additionalbreakdown of mutual fund products 530 may be associated with the productlogo 308.

In another example, products such as investments or banking accounts mayhave fluctuating value over time (e.g., stock exchange movement orday-to-day credits/debits associated with bank accounts). As describedabove, the fulfillment server 120 may generate augmented reality outputassociated with current personal data based on updated market values 540for display as augmented reality output. In the present example, theupdated market values 540 may be overlaid on legacy data. When thedocument 300 is viewed using the display of the client device 110, thelegacy data may appear to be obscured or overwritten by augmentedreality output representing the updated market values 540. For instance,a legacy data value (e.g., $23,111) associated with a “RegisteredB-series” product illustrated in FIG. 3 may be obscured or overwrittenwith an updated market value 540 (e.g., $25,000) in FIG. 5. Or a legacydata value (e.g., $433) associated with a “Non-Registered A-series”product illustrated in FIG. 3 may be obscured or overwritten with anupdated market value 540 (e.g., $1,288) in FIG. 5.

In some examples, the respective document markers may be associated withinstructions associated with location placement of the augmented realityoutput relative to legacy data. In FIG. 5, the text string “B-series”(e.g., a document marker) may be associated with relative location datato identify that augmented reality output associated with an aggregate“Total Value”, that is associated with the authenticated user for theB-series product, shall be displayed/rendered in a region to the rightside of the text string “B-series”. Other methods of determiningplacement of augmented reality output may be contemplated.

In some further examples, the augmented reality output may include oneor more graphs or charts associated with the personal data from theaccount record. For instance, the augmented reality output may include apie chart 532 visually illustrating asset allocation information for theauthenticated user. In some examples, the authenticated user mayinstruct, via a user interface, the client device 110 to capture ascreen shot of the augmented reality output in combination with thevisual representation of the document for the user's records. It may beappreciated that the one or more document markers, augmented realityoutput, or the document 300 illustrated in FIG. 3 and FIG. 5 areexamples. Other document markers, augmented reality output, or documentsmay be contemplated.

As described, the client device 110 may be configured to provideaugmented reality output for a live-view display of the document 300.For instance, the user may position the client device 110 to capture alive-view image of the document 300. In response to operations describedherein, the client device 110 may receive the display data based onpersonal data to provide the augmented reality output as the live-viewimage of the document 300. The display data for providing the augmentedreality output may be provided in near real-time such that the augmentedreality output may be provided while the live-view image of the document300 is active. The user may be restricted to viewing informationassociated with that user's personal data and not of other users.

In the examples described herein, the augmented reality output may beassociated with respective users. When the client device 110 isauthenticated based on credentials of a first user, the augmentedreality output may be substantially different than the augmented realityoutput associated with a second user. The first user and the second usermay be associated with different personal data and in different accountrecords.

The image capture device 116 (e.g., of the client device 110) maycapture a substantially whole view of the document 300. In somescenarios, the client device 110 may be positioned nearer to thedocument 300 such that the image capture device 116 may capture apartial view of the document 300. To illustrate, reference is made toFIG. 6, which illustrates an example partial view 600 of the document300 of FIG. 3.

In FIG. 6, as compared to a substantially whole view of the documentillustrated in FIG. 3, the client device 110 may be positioned nearer tothe document 300 such that the client device 110 captures a view of aleft-hand side of the document 300. That is, the client device 110 maycapture an image including the summary list 306 of products associatedwith the user and to the exclusion of other portions of the document300. Accordingly, based on obtained personal data from an account recordassociated with an authentication credential, the client device 110 maydisplay augmented reality output associated with the product logo 308 orother keyword document markers. In FIG. 6, the augmented reality outputincludes the updated market values 540. That is, the client device 110may display augmented reality output insofar as supplemental datacorresponds to the relevant subset portion of the document as capturedby the image capture device 116.

Reference is made to FIG. 7, which illustrates, in flowchart form, amethod 700 of augmenting objects associated with personal data, inaccordance with an example of the present application. The method 700includes operations that may be carried out by one or more processors ofthe fulfillment server 120 (FIG. 1). For example, the method 700 may beimplemented, at least in part, through processor executable instructionsassociated with the augmentation application 122 (FIG. 1). In someexamples, one or more operations may be implemented via processorexecutable instructions in other applications or in an operating systemstored and executed on the fulfillment server.

As described, personal data may include dynamic data varying over time.For example, investment products may have fluctuating value over time.It may be desirable to provide augmented reality output that isassociated with current or updated data.

At operation 702, the processor may identify legacy data being displayedin a document 300. For example, the fulfillment server 120 may receive,from the client device 110, an image of the document 300 illustrated inFIG. 3 and may identify legacy data being displayed in the document 300.For example, the document 300 states that the “Registered B-series”holdings associated with the authenticated user have an aggregate totalvalue of $23,111. However, the stated aggregate total value may be at aparticular point in time (e.g., last day of the previous month). Thedata values illustrated in the document 300 may be outdated and theaggregate total value of $23,111 may be regarded as a legacy data value.

In the foregoing example, the processor may be configured to query thetotality of data types associated with the document 300 to identifywhether the respective data values may be outdated. Continuing with theabove example, the processor may query the client data record associatedwith the authenticated user to determine whether the aggregate totalvalue (e.g., for the “Registered B-series” holding) data of $23,111 haschanged. That is, the processor may determine that the aggregate totalvalue has changed if the current market value is different than $23,111.Other methods of determining whether data of the document 300 isoutdated may be contemplated.

At operation 704, the processor may obtain updated or current personaldata (e.g., data as of the time of data retrieval) from the client datarecord 124 associated with the authenticated user. In some scenarios,the processor may also generate the display data for displayingaugmented reality output based on the current personal data.

At operation 706, the processor may determine whether the currentpersonal data is substantially the same as the legacy data displayed inthe document 300. In some examples, the processor may conduct imagerecognition operations to identify the legacy data displayed in thedocument 300 and may compare the identified legacy data with the currentpersonal data. In the scenario that the legacy data displayed in thedocument 300 is substantially the same as the current personal dataassociated with the client data record 124, the processor may notgenerate augmented reality output to obscure or overwrite legacy datawhen viewing the document 300 using the client device 110.

In the scenario that the legacy data displayed in the document 300 isnot substantially the same as the legacy data of the document 300, theprocessor, at operation 708, may transmit, to the client device 110,display data for displaying augmented output data based on the currentpersonal data overlaying the legacy data to overwrite or obscure thelegacy data when the document 300 is viewed using the client device 110.As illustrated in FIG. 5, the updated market values 540 may appearoverlaid atop the legacy values of the document 300 when the document300 is viewed via the client device 110.

As described, the fulfillment server 120 (FIG. 1) may generate displaydata based on personal data for configuring the client device 110 todisplay an augmented reality output based on the personal data and theat least one further image of the document. That is, the augmentedreality output may be associated with numerous augmented reality outputportions. Referring again to FIG. 5, the augmented reality outputassociated with the document 300 may include a registered taxpayeridentification number 520, beneficiary names “Bill Ip and Ann Greene”522, a granular breakdown of mutual fund products 530, pie charts 532 orother graphical illustrations based on personal data, updated marketvalues 540, or the like.

Because an augmented reality output may be associated with a largequantity of augmented reality portions, it may be desirable to allow anauthenticated user to identify a subset of augmented reality outputportions for display. In some examples, the fulfillment server 120 mayreceive, from the client device 110, a user selection for identifying asubset of available augmented reality output. Further, the fulfillmentserver 120 may transmit further display data to display the selectedsubset of the augmented reality output at the client device 110. In anexample scenario with reference to FIG. 5, an authenticated user maydesire viewing augmented reality data associated with asset allocationmix information via a pie chart 532. In the present example scenario,the fulfillment server 120 may generate the display data for displayingaugmented reality output of the pie chart 532 to the exclusion of otherpersonal data. For instance, the authenticated user may be uninterestedin displaying beneficiary names.

Reference is made to FIG. 8, which illustrates, in simplified blockdiagram form, an electronic device 800, in accordance with an example ofthe present application. The electronic device 800 can be the clientdevice 110 of FIG. 1. The electronic device 800 includes one or moreprocessors 802, memory 804, and a communications module for providingnetwork capabilities to communicate with other computing devices. Thememory 804 may store processor executable software applications 806 thatinclude an operating system to provide basic device operations. Thesoftware applications 806 may also include instructions implementingoperations of the methods described herein.

The electronic device 800 includes a display interface and/or a display808. The display 808 may be any suitable display such as a liquidcrystal display (LCD), an e-ink/e-paper display, or the like. In someexamples, the display 808 may be a touchscreen display. The electronicdevice 800 includes an input module 810 for receiving signalsrepresenting commands described in examples herein. In some examples,the input module 810 may be a keyboard device, a touch input device, ora microphone for receiving acoustic input from a user of the electronicdevice 800. The electronic device 800 may also include an image capturedevice 812. The image capture device 812 may correspond to the imagecapture device 116 of FIG. 1 for capturing images of objects ordocuments and/or providing a live view of the objects or documents onthe display 808.

In some examples, the electronic device 800 may be a portable electronicdevice, such as a smartphone, a personal computer, a personal digitalassistant, a portable navigation device, a mobile phone, a wearablecomputing device (e.g., smart watch, wearable activity monitor, or thelike), or any other type of computing device that may be configured tostore data and software instructions, and execute software instructionsto perform example operations described herein.

Reference is made to FIG. 9, which illustrates, in simplified blockdiagram form, a server 900, in accordance with an example of the presentapplication. The server 900 may be the fulfillment server 120 of FIG. 1.The server 900 includes one or more processors 902, memory 904, and acommunications module for providing network capabilities to communicatewith other computing devices. The memory 904 may include data records990. In the example of the fulfillment server 120, the data records 990may include the client data records 124 and/or the resource records 126of FIG. 1.

The memory 904 may also include applications 982 having instructions forperforming operations described herein. In an example of the fulfillmentserver 120, the applications 982 may include the augmentationapplication 122 of FIG. 1.

Example embodiments of the present application are not limited to anyparticular operating system, system architecture, mobile devicearchitecture, server architecture, or computer programming language.

It will be understood that the applications, modules, routines,processes, threads, or other software components implementing thedescribed method/process may be realized using standard computerprogramming techniques and languages. The present application is notlimited to particular processors, computer languages, computerprogramming conventions, data structures, or other such implementationdetails. Those skilled in the art will recognize that the describedprocesses may be implemented as a part of computer-executable codestored in volatile or non-volatile memory, as part of anapplication-specific integrated chip (ASIC), etc.

Certain adaptations and modifications of the described embodiments canbe made. Therefore, the above discussed embodiments are considered to beillustrative and not restrictive.

What is claimed is:
 1. A computing system comprising: a communicationmodule; a processor coupled to the communication module; and a memorycoupled to the processor, the memory storing instructions that, whenexecuted, configure the processor to: receive, from an authenticatedclient device, an image of a non-user specific account statementtemplate document; obtain, from an account record, current personal dataassociated with the authenticated client device, the current personaldata including dynamic data which varies over time; generate displaydata for configuring the authenticated client device to display anaugmented reality output based on the current personal data, theaugmented reality output converting the non-user specific accountstatement template document to a user specific account statementdocument that includes at least some of the current personal data; andconfiguring the authenticated client device to display the augmentedreality output.
 2. The computing system of claim 1, wherein theinstructions, when executed, further configure the processor to:receive, from a second authenticated client device, an image of anon-user specific account statement template document; obtain, from asecond account record, current personal data associated with theauthenticated second client device, the current personal data includingdynamic data which varies over time; generate display data forconfiguring the second authenticated client device to display anaugmented reality output based on the current personal data obtainedfrom the second account record, the augmented reality output convertingthe non-user specific account statement template document to a userspecific account statement document that includes at least some of thecurrent personal data; and configuring the second authenticated clientdevice to display the augmented reality output.
 3. The computing systemof claim 1, wherein the current personal data includes banking accountdata having dynamically changing value over time.
 4. The computingsystem of claim 1, wherein obtaining the current personal dataassociated with the authenticated client device is subsequent toauthenticating the client device based on a credential.
 5. The computingsystem of claim 1, wherein the augmented reality output includes alive-view display of the non-user specific account statement templatedocument.
 6. The computing system of claim 1, wherein the instructions,when executed, further configure the processor to identify a documentmarker using image recognition.
 7. The computing system of claim 6,wherein the document marker includes at least one of a keyword, abarcode, or a graphical symbol.
 8. The computing system of claim 1,wherein the augmented reality output includes at least one of graphs orcharts associated with the current personal data.
 9. The computingsystem of claim 1, wherein the instructions, when executed, furtherconfigure the processor to: receive, from the authenticated clientdevice, a user selected subset of the augmented reality output; andtransmit, to the authenticated client device, further display data fordisplaying the user selected subset of the augmented reality output atthe authenticated client device.
 10. A computer-implemented method ofaugmenting objects associated with personal data, the method comprising:receiving, from an authenticated client device, an image of a non-userspecific account statement template document; obtaining, from an accountrecord, current personal data associated with the authenticated clientdevice, the current personal data including dynamic data which variesover time; generating display data for configuring the authenticatedclient device to display an augmented reality output based on thecurrent personal data, the augmented reality output converting thenon-user specific account statement template document to a user specificaccount statement document that includes at least some of the currentpersonal data; and configuring the authenticated client device todisplay the augmented reality output.
 11. The method of claim 10,further comprising: receiving, from a second authenticated clientdevice, an image of a non-user specific account statement templatedocument; obtaining, from a second account record, current personal dataassociated with the authenticated second client device, the currentpersonal data including dynamic data which varies over time; generatingdisplay data for configuring the second authenticated client device todisplay an augmented reality output based on the current personal dataobtained from the second account record, the augmented reality outputconverting the non-user specific account statement template document toa user specific account statement document that includes at least someof the current personal data; and configuring the second authenticatedclient device to display the augmented reality output.
 12. The method ofclaim 10, wherein the current personal data includes banking accountdata having dynamically changing value over time.
 13. The method ofclaim 10, wherein obtaining the current personal data associated withthe authenticated client device is subsequent to authenticating theclient device based on a credential.
 14. The method of claim 10, whereinthe augmented reality output includes a live-view display of thenon-user specific account statement template document.
 15. The method ofclaim 10, further comprising identifying a document marker using imagerecognition.
 16. The method of claim 15, wherein the document markerincludes at least one of a keyword, a barcode, or a graphical symbol.17. The method of claim 10, wherein the augmented reality outputincludes at least one of graphs or charts associated with the currentpersonal data.
 18. The method of claim 10, further comprising:receiving, from the authenticated client device, a user selected subsetof the augmented reality output; and transmitting, to the authenticatedclient device, further display data for displaying the user selectedsubset of the augmented reality output at the authenticated clientdevice.
 19. A non-transitory computer-readable storage medium storinginstructions for augmenting objects associated with personal data, theinstructions, when executed by a processor of a computing device, causethe computing device to: receive, from an authenticated client device,an image of a non-user specific account statement template document;obtain, from an account record, current personal data associated withthe authenticated client device, the current personal data includingdynamic data which varies over time; generate display data forconfiguring the authenticated client device to display an augmentedreality output based on the current personal data, the augmented realityoutput converting the non-user specific account statement templatedocument to a user specific account statement document that includes atleast some of the current personal data; and configuring theauthenticated client device to display the augmented reality output. 20.The non-transitory computer-readable storage medium of claim 19, whereinthe current personal data includes banking account data havingdynamically changing value over time